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BACKGROUND OF THE INVENTION 

The present invention relates to the field of echo cancellers, and in particular to an echo 
canceller that includes an adaptive filter that employs a dynamically adjustable step size. 

As known, bothersome echoes occur in communication systems, such as telephone systems, 
mlO that operate over long distances or in systems that employ long processing delays, such as digital 
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H cellular systems . The echoes are the result of electric leakage in the four-to-two/two-to-four wire 
hybrid circuit, due to an impedance mismatch in the hybrid circuit between the local loop wire and 
the balance network. To reduce the echoes, communication systems typically include one or more 
echo cancellers. 

FIG. 1 is a block diagram illustration of a communication system 10 that connects at least 
two subscribers 12, 14. The first subscriber 12 is typically connected to the communication 
system 10 via a two-wire line 16 and a hybrid circuit 18. The hybrid circuit 18 connects the two- 
wire line 16 to the four-wire lines 20, 22. The first four-wire line 20 provides a signal to the 
second subscriber via a second hybrid circuit 24 and a two-wire line 26. Similarly, signals from 
2 0 the second subscriber 14 are routed to the first subscriber 12 over the two-wire line 26, the second 
hybrid circuit 24 and the four-wire line 20, 22. In one application, the hybrid circuits may be 
located in the telephone company central offices. To reduce the echo signals coupled by the 
hybrid circuit due to impedance mismatches, echo cancellers 30, 32 are included to attenuate the 
undesirable echoes. 
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Echo cancellers typically include an adaptive filter that generates an estimate of the echo 
and subtracts the estimate from the return signal. Like any adaptive discrete time filter, the tap 
weights of the filter are adjusted based upon the difference between the estimate of the echo signal 
and the return signal. The adaptive filter employs an adaptive control algorithm to adjust the tap 
5 weights in order to drive the value of the difference signal to zero or a minimum value. 

A problem with prior art echo cancellers is the relatively long time it takes for the adaptive 
control algorithm to adapt the filter tap weights in order to drive the error signal value to zero. 
O This is often referred to as speed of convergence. A widely used technique for adapting the tap 

!S weights is referred to as the least-mean-square (LMS) algorithm. Advantageously, the LMS 
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r 10 algorithm is relatively easy to implement since it does not require measurements of the pertinent 
correlation functions, nor does it require matrix inversions. In order to decrease the amount of 

Q 

P time it takes to drive the difference signal to zero, the adaptive control algorithm may adjust the 
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M step size p used in the LMS algorithm to a larger value. Although using a relatively large fixed 
IU step size p facilitates a rapid convergence, the large step size results in a relatively large residual 
15 error following convergence. As a trade-off between rapid convergence and a small residual 
error, some systems have employed a relatively large step size initially and then switch to a 
smaller predetermined step size as a function of sample count (i.e., time). This approach takes 
advantage of the improved speed of convergence associated with the initial large step size value, 
and the relatively small residual error associated with the smaller step size value. 
2 0 Another problem with prior art echo cancellers has been the relatively large computational 

burden associated with the echo cancellers. In a digital signal processor embodiment (DSP), the 
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echo canceller requires a relatively large percentage of the DSP's available processing power (e.g. , 
MIPS). Similarly, in an application specific integrated circuit (ASIC) embodiment the relatively 
large computational burden leads to the use of a large number of gates to implement the echo 
canceller. 

U.S. Patent 6,223,194 entitled "Adaptive Filter, Step Size Control Method Thereof, and 
Record Medium Therefor" discloses various embodiments for adjusting the step size. However, a 
problem with the techniques and embodiments set forth in U.S. Patent 6,223,194 is that they 
require a divide operation in order to compute the step size. Divide operations are undesirable in 
both DSP embodiments and ASIC embodiments of echo cancellers. Other embodiments disclosed 
in U.S. Patent 6,223,194 are also computationally inefficient due to their need to compute square 
roots and vector norms. 

Therefore, there is a need for an improved technique for dynamically adjusting the step size 
fi in an echo canceller having an adaptive filter that employs a stochastic quadratic descent 
algorithm such as LMS. 

SUMMARY OF THE INVENTION 

Briefly, according to an aspect of the invention, an echo canceller adapted for use in a 
communication system includes a hybrid circuit that comprises an adaptive digital filter. The 
adaptive filter generates an estimated echo signal z[k] in response to: (i) a sampled input data 
sequence x[k] and (ii) an error signal sequence e[k] indicative of the difference between a near 
end signal sequence y[k] and the estimated echo signal z[k] . The adaptive digital filter computes 
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filter coefficients based upon the error signal sequence e[k] using a stochastic quadratic descent 
estimator that employs a dynamically adjustable step size vector u_[£] . The adaptive digital filter 
computes the dynamically adjustable step size vector u_[fc] of the form 
[i[k + 1] = ]i[k] +a$[k] • £k]e[k] . In one embodiment, the vector §[k] is updated according to 
5 the relationship + 1] = • (1 -a[*] • x 2 [£]) + x[*]e[fc] , where a is a small positive scalar 
and the vectors are defined as w[fc] = Mfc],w#],...,M£]f A • B denotes the dot product 

between vectors A and B . 

Briefly, according to another aspect of the present invention, an echo canceller adapted for 
use in a communication system that includes a hybrid circuit comprises an adaptive digital filter. 
s " 1 0 The adaptive filter generates an estimated echo signal z[k] in response to: (i) a sampled input data 
sequence *[*] and (ii) an error signal sequence e[k] indicative of the difference between a near 
end signal sequence y[k] and the estimated echo signal z[k]- The adaptive digital filter computes 
filter coefficients based upon the error signal sequence e[k] using a stochastic quadratic descent 
estimator that employs a dynamically adjustable step size vector \x[k] . The adaptive digital filter 
15 computes the dynamically adjustable step size dynamically adjustable step size vector u_[fc] , where 

%[k] is an empirically derived set of values 

In a preferred embodiment the stochastic quadratic descent estimator includes an LMS 
estimator that employs a dynamically adjustable step size vector p[fc] . 

The closed loop and open loop computational techniques of the present invention provide a 
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computationally efficient technique for dynamically adjusting the step size of the adaptive filter, 
with good speed of convergence. 

These and other objects, features and advantages of the present invention will become more 
apparent in light of the following detailed description of preferred embodiments thereof, as 
illustrated in the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWING 

FIG. 1 is a block diagram illustration of a communication system that includes an echo 

canceller; 

FIG. 2 is a block diagram illustration of an echo canceller; 

FIG. 3 is a block diagram illustration of an adaptive filter used within the echo canceller of 
FIG. 2; and 

FIG. 4 is a flow chart illustration of processing steps performed by the adaptive filter of 
FIG. 3. 

DETAILED DESCRIPTION OF THE INVENTION 

FIG. 2 is a functional block diagram illustration of an echo canceller 22. The echo 
canceller 22 receives a near end input signal sequence n[k] on a line 40, and due to the 
undesirable impedance mismatch of the hybrid circuit, an echo signal sequence z[k] on a line 42 is 
coupled to the near end input signal sequence n[k] to provide a signal sequence y[k] on a line 44. 



The echo signal sequence z[k] on the line 42 is equal to the product of the far end transmit signal 
sequence x[k] on a line 45 and hybrid circuit impulse response h 46 (i.e., z[k] = h T [k]x[k]). 
Significantly, the echo canceller 22 includes an adaptive filter 48 that provides a estimated echo 
signal sequence z[k] on a line 49. A difference signal e[k] indicative of the difference between 
the signal sequence y[k] and the estimated echo signal sequence z[k] is computed and provided 
on a line 50. 

Ideally, if the coefficients of the adaptive filter 48 are selected such that the impulse 
response h[k] of the adaptive filter is equal to the impulse response h 46 of the hybrid circuit, 
then the value of the difference signal e[k] on the line 50 will be zero in the absence of near end 
input sequence n[k] . Accordingly, the adaptive filter 48 adapts its tap weights to drive the value 
of the difference signal e[k] on the line 50 to a minimum/optimum value (e.g., preferably zero). 

FIG. 3 is a block diagram illustration of the adaptive filter 48 used within the echo 
canceller of FIG. 2. The adaptive filter 48 includes an adaptive control algorithm 56 that receives 
the difference signal e{k] on the line 50 and computes a value for each of the N coefficients h t [k] 
57-60. The adaptive filter receives the far end signal sequence x[k] on the line 45 which is 
multiplied by first coefficients h,[k] 57, and the resultant product on a line 64 is input to a 
summer 66. The far end signal sequence x[k]on the line 45 is also input to the adaptive control 
algorithm 56. Similarly, a delayed version of the far end signal sequence x[k-l] on a line 68 is 
multiplied by second coefficients h 2 [k] 58, and the resultant product on line 70 is also input to the 



summer 72. The product from each of the tap weights (e.g., 59, 60) is summed to generate the 
estimated echo signal z [k] on the line 49. Details of the adaptive control algorithm 56 shall now 
be discussed. 

FIG. 4 is a flow chart illustration of processing steps 100 performed by the adaptive filter 
5 of FIG. 3. A first step 102 involves initializing the echo canceller, including setting the estimated 

impulse value at time k=0 to zero (i.e. , h[0] = 0 ) and setting the step size value at time k=0 to an 

initial value (i.e., ^i[0] = jn 0 ). In addition, the vector § at k=0 is also set to an initial value of 

$• * 

q zero (i.e. , <j>[0] = 0). The details of the vector §[k] shall be presented hereinafter. The value of 
|| the initial step size ^ 0 can be selected by analyzing the transient behavior of the mean squared 

■ 

SI 10 error of the LMS algorithm. From this analysis it is known that the step-size requirements for 
si- 
speed of convergence and steady state residual error are opposed. A large step-size will result in a 

S fast speed of convergence but will render a high residual error, and conversely a small step-size 

ill would result in opposite behavior. Typically, in communication system applications the echo 

canceller requires a fast speed of convergence and a low residual error. A fixed step-size can not 

1 5 satisfy both requirements at once, therefore it is desirable to use a dynamically adjustable step-size. 

It is also known, that the step-size must be bounded to ensure algorithm stability. In this 

application, the initial step-size value would be chosen relatively large such that it achieves a fast 

speed of convergence, but of course within the stability boundaries. Step 104 is then performed to 

compute the estimated echo signal z[k] . The estimate z[k] can be computed using the expression: 

2 0 z[k] = h T 0 [k]x[k] EQ. 1 



- 8 - 



Step 106 is performed next to compute the difference signal e[k] using the following expression: 



e[k] = y[k] - z[k] = h T 0 [k]x[k] + n[k] - h [h]x[k] EQ. 2 

Step 108 then computes new filter coefficient values. Specifically, the estimated impulse response 
is computed as follows: 

h[k + 1] = h[k] + • x[*M*] EQ. 3 

where: 

\x[k] is the past value of the step size vector, 

A 

Notably, the estimated impulse response h[k] is preferably a function of the step size vector , 
the input signal x[k] and the difference signal e[k] , As discussed above, selecting the value of 
the step size \x[k] has classically involved a tradeoff between convergence speed and steady state 

error. According to an aspect of the present invention, step 1 12 is performed next to compute the 
dynamically adjustable step size vector \x[k] . Of course the step size value must always be in a 

range so the filter remains stable. 

Step 112 computes vector §[k] using the following expression: 



<j> [k + 1] = <j> [k] • (1 - \x[k] • x [k]) + e[k]x[k] 



EQ. 4 



A 

The vector §[k] denotes the gradient of the i element of the coefficient vector h[k] with respect 
to the 1 th element of step size vector ja[£] . Step 1 12 then computes a new value for the step size 
|n , using the following equation: 

ix[k + 1] = \x[k] + oc£[Jt] • x[k]e[k] |£ EQ. 5 

where, 

a is a small positive scalar constant value. 
Significantly, the present invention provides a computationally efficient technique for dynamically 
adjusting the step size with adaptive filter, with good speed of convergence. 

In an alternative embodiment, it is contemplated that the step size \x[k] may be adaptively 
computed using an open loop computation that does not use the error sequence e[k] , nor the input 
signal. The step size is then computed using the following equation: 

[i{k + l]=\i[k] + ^[k] EQ. 6 

where £>[k] is an empirically derived set of values. 

The echo canceller may be implemented in a DSP, an ASIC, or a general purpose 
processor. 

Although the present invention has been shown and described with respect to several 



preferred embodiments thereof, various changes, omissions and additions to the form and detail 
thereof, may be made therein, without departing from the spirit and scope of the invention. 
What is claimed is: 
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